Liquid crystal phases of ultracold dipolar fermions on a lattice 
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Motivated by the search for quantum liquid crystal phases in a gas of ultracold atoms and 
molecules, we study the density wave and nematic instabilities of dipolar fermions on the two- 
dimensional square lattice (in the x — y plane) with dipoles pointing to the z direction. We de- 
termine the phase diagram using two complementary methods, the Hatree-Fock mean field theory 
and the linear response analysis of compressibility. Both give consistent results. In addition to the 
staggered (71", n) density wave, over a finite range of densities and hopping parameters, the ground 
state of the system first becomes nematic and then smectic, when the dipolar interaction strength 
is increased. Both phases are characterized by the same broken four-fold (C4) rotational symmetry. 
The difference is that the nematic phase has a closed Fermi surface but the smectic does not. The 
transition from the nematic to the smectic phase is associated with a jump in the nematic order 
parameter. This jump is closely related to the van Hove singularities. We derive the kinetic equation 
for collective excitations in the normal isotropic phase and find that the zero sound mode is strongly 
Landau damped and thus is not a well defined excitation. Experimental implications of our results 
are discussed. 

PACS numbers: 71.10.Fd, 71.10.Hf, 77.84.Nh, 37.10.Jk 



I. INTRODUCTION 



It is well known that as the strength of Coulomb in- 
teraction is increased with respect to the kinetic energy, 
an electron gas goes from a liquid state to a crystalline 
phase [l[ . However the transition from a liquid to a crys- 
tal phase in fermionic systems with long range interac- 
tion may contain several intermediate stages bearing the 
name of "electronic liquid crystal" phases [2|. Analo- 
gous to the classical liquid crystals [3|, these phases are 
classified as being "nematic" and "smectic" according to 
their symmetry breaking (Fermi surface deformation) as 
compared to the isotropic case. In the nematic phase 
[4|4y]' the rotational symmetry is broken so the typical 
Fermi surface has a cigar- like shape, i.e., it is stretched 
in one direction and shrunk in other directions. In the 
smectic phase the system is effectively in a reduced di- 
mension [J| , accordingly the Fermi surface is divided into 
disconnected pieces. The transition to the smectic phases 
is thus naturally connected to dimensional crossover phe- 
nomena which have drawn many interests [lOl - flsT ] . 

Electronic nematic order has been observed and stud- 
ied in a number of solid state materials, such as transi- 
tion metal oxides [T3 - [T7| and quantum Hall systems (e.g., 
GaAs/AlGaAs heterostructure in high magnetic field) 
[HI, [l9j] . These systems are typically two-dimensional and 
signatures of nematic order include additional peaks in 
neutron scattering [l4| and transport anisotropy [l8l . [20| . 
The nematic order can be viewed either as fluctuations 
(disordering) of static stripe-like ordered stat es Uilj or as 
an instability of the liquid (isotropic) states [22| ■ Possi- 
ble nematic order in the two-dimensional Hubbard model 



has been extensively discussed in the context of high tem- 
perature superconductors [3, [IH, [23j]. Away from half 
filling, a stripe order can be stabilized by the antifer- 
romagnetic (AF) spin exchange. For example, at 1/8 
doping, three quarters of sites have one localized elec- 
tron with AF spin arrangement maximizing the energy 
gain from spin-exchange, while the rest one quarter of 
sites have an average 0.5 delocalized electron propagat- 
ing along one particular direction forming "conducting 
veins"; these conducting veins appear ever y fo ur lattice 
constants constituting the stripe phase (lil. TTslj. The ne- 
matic order can thus be viewed as quantum and/or ther- 
mal fluctuations of these static stripes [H, H3- Similar- 
understanding applies to quantum Hall systems as well 
ii. 
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Because of their excellent tunability with dipole mo- 
ments, cold polar molecular gases have been proposed 
as an ideal system to study the electronic liquid crys- 
tal phases [2fJ-[3fJ]. Under an external electric or mag- 
netic field, all dipoles are aligned along the field direc- 
tion, and the potential energy between two dipoles is 
V(R) = d 2 [l - 3cos 2 6»]/|fi| 3 , with d the induced dipole 
moment, R the relative position between the two dipoles, 
and 9 the angle between the applied field and R. Since 
the induced dipole moment is proportional to the exter- 
nal field, by tuning the amplitude and the angle (relative 
to the system) of the field one can directly control the 
strength of long-range interaction. Recently, there ap- 
peared many theoretical works on dipolar Fermi gas in 
the continuum (3ll - [37| . By contrast, studies on dipo- 
lar fermions on lattices are relatively few and focus on 
anisotropic lattices [381 ] - 

In this paper we consider the simplest possible system 
where a single species of dipolar fermions are loaded into 
the square optical lattice (in the x — y plane) [39| with the 
external field along the z direction, schematically shown 
in Fig. 0Ja). In this setup the dipolar interaction has the 
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simple form d 2 /R 3 . We focus on the instabilities of the 
normal isotropic phase. We find that the transitions from 
isotropic to liquid crystal phases are generally of first or- 
der. The transitions to smectic phase are associated with 
a jump in the order parameter which is closely related to 
the van Hove singularities in the low dimensional lattices 
[23l |40| . Our estimate shows that the magnitude of dipole 
moment required to achieve the liquid crystal phases is 
within the reach of current experiments of hetero-nuclear 
polar molecules. The rest of the paper is organized as 
follows. In section II, we introduce our model Hamilto- 
nian and define all relevant phases. We also discuss the 
van Hove points in this model and the special features of 
dipolar scattering between them. In Section III, we ana- 
lyze in detail the various instabilities from the isotropic 
state to obtain the phase diagram of the system. This 
is done by Hatree-Fock mean field theory and linear re- 
sponse analysis of the compressibility. Special attention 
is paid to understand the order of normal-nematic and 
nematic-smectic transitions. In section IV we study the 
collective excitations in the isotropic phase. We briefly 
discuss the implications of our results to experiments in 
section V before conclude in section VI. 
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FIG. 1: (a) The experimental setup: a square lattice in the 
x — y plane and the applied field (either electric or magnetic) 
along the z direction. The dipole moments of fermions are 
aligned along the z direction which leads to large intersite 
density-density interaction, (b) The staggered density wave: 
the density is more concentrated on one sublattice than the 
other. The size of circle indicates the density at the given 
site, (c) The nematic phase: the effective hoppings along x 
and y are different, (d) The first Brillouin zone of the square 
lattice. Four circles (A, B, a, ft) mark the regions near the van 
Hove points. The interaction between the opposite van Hove 
points is Ui, and for neighboring van Hove points is TJi. 



II. MODEL AND DEFINITION 

The general Hamiltonian for single species of dipolar 
fermions on the square lattice is 



ijTiiflj (.1 



E( £ £ - + jf E V(k)ptf_ s . (1) 



Here, is the hopping amplitude between site i and j, 
Vij cx d 2 /\ri — fj\ 3 is the (repulsive) dipolar interaction 
between site i and j, V(k) is the Fourier transform of 
Vij, N is the total number of sites, eg is the bare (in 
the absence of Vij) band energy dispersion, and pg — 
y"!=.c Since the intersite repulsion takes the form 

^1 q+k q * 

of density-density interaction, this model is sometimes 
referred to as the extended Hubbard model [4l|. The 
actual calculation is done for a given density (particle 
per site) n, and the chemical potential p is adjusted to 
yield the fixed density. 

First we give the precise definitions of several phases in 
our system. Due to the presence of lattice, the "isotropic" 
or normal phase is a state that has the same symmetry 
of the Hamiltonian. In the nematic phase, the C4 rota- 
tion symmetry is reduced to C2 but the lattice transla- 
tional symmetry still holds in both the x and y direc- 
tion. A further constraint is that the Fermi surface is 
closed. On the mean field level, the nematic phase can 
be viewed as the effective hopping amplitudes (renormal- 
ized by the dipolar interaction) along the x and y di- 
rection are different, as demonstrated in Fig. [Tfc). The 
transition from the isotropic to the nematicphase is also 
referred to as Pomeranchuk instability [23], [42j. The 
smectic phase has the same symmetry as the nematic, 
but has an open Fermi surface. The transition from the 
nematic to the smectic phase is a Lifshitz transition [43[ 
where the topology of Fermi surface changes. Finally, we 
also consider the possibility of the staggered density wave 
(sDW) phase, in which the average density on one sub- 
lattice is different from the other sublattice, as illustrated 
in Fig. [lib). 

Compared to the continuum gas, an important fea- 
ture of the two dimensional lattice is the van Hove sin- 
gularity in the density of states. The van Hove points 
(fey j?) are fc-points in the reciprocal space with vanish- 
ing group velocity Vgeg|g_g = 0. In two-dimension, 
this leads to a logarithmic divergence in the density of 
states, i.e. the density of states g(e) ~ — log |e — evh\ 
where £vh = e % H ^ s ^ ne van Hove energy. The lattice 
symmetry implies that for a non-zero kyn, ah other k 
points generated by symmetry transformations of kvu 
are also van Hove points. When the chemical potential 
is close to £vh, most low energy excitations are around 
kvH: so interactions between states near the van Hove 
points become dominantly important. 



3 



Our subsequent discussion will be valid for the gen- 
eral form of the Hamiltonian Eq. ([1]). In the numerical 
simulation, however, we choose a specific Hamiltonian as 
follows. We keep the first and second nearest neighbor 
hopping t and t' , which gives eg = — 2t(cosk x + cosfc y ) — 
At' cos k x cos k y . Since the strength of dipolar interaction 
falls off rapidly as a function of distance (1/r 3 ), we con- 
sider the case where the lattice constant is large enough 
so that only the nearest neighbor density-density inter- 
action is kept [Hj]. Under this simplification the dipolar 
interaction strength is described by a single parameter U 
(>0), i.e., in Eq. (UJ V i3 = (U/2)5ij±a with a — x or y 
and V(k) = +J7/2(cos k x -\- cos/cy). The specific model 
is thus parametrized by the hopping t and t' , the dipolar 
interaction strength U, and the filling (density) n. All en- 
ergies are measured in unit of t for the remaining discus- 
sion. For this model, the van Hove points are located at 
(0, ±7r) and (±7r, 0). They are labeled by A, B and a, /3, 
respectively as shown in Fig. QJd). As we shall explic- 
itly show in next section (the discussion below Eq. (J7])), 
— 2V(k~ k') is identified as the interaction between states 
labeled by k and k' . We point out here that the dipolar 
interaction between opposite van Hove points (such as A 
and B in Fig. [TJd)) is attractive, 

U t = -2V(k - k% =( _^ fi)iP=(wfi) = -2U, (2) 

while it is repulsive between neighboring van Hove points 
(such as A and a in Fig. Hfd)), 

U 2 = -2V(k fcOljHo.^Ko) = + 2U - ( 3 ) 

This property of dipolar interaction is very important 
for our discussion of the nematic instability in the next 
section. 



III. PHASE DIAGRAM 

First, we use Hartree-Fock (HF) approximation to 
study the ground state of the system Eq. (TT]) at zero 
temperature. HF mean field theory has been playing an 
important role in previous studies of electronic nematic 
phases @, H, HI] . We consider and compare two possible 
symmetry breaking phases: the staggered density wave 
and the nematic phase. We have also considered the d- 
density wave state [ill, E3| but found it has higher energy 
than the staggered density wave (also known as s-density 
wave in Ref . [4JJ ) , so we shall not discuss it in any detail 
here. 

Staggered Density Wave (sDW): In this phase, the 
fcrmion density is more concentrated on one of the square 
sublattices as shown in Fig. [Tib), so (pg) is nonzero with 

Q = (it, n). This arrangement can reduce the nearest 
neighbor repulsion energy, which is the dominant interac- 
tion energy. Within the HF approximation, the reduced 



Hamiltonian for this phase is simply 

H S H T = E( £ fc - + 2V(Q)M sDW p 

k 

- NV{Q)M 2 sDW . (4) 
Here, the sDW order parameter M s nw is given by the 

Q(H sDW \ 

self-consistent equation g M H ^ w = 0, 

AW^£<4 + g%>- (5) 

By solving Eq. ((4]) and ([5]), one can obtain the criti- 
cal interaction strength U c above which M s uw becomes 
nonzero. 

Nematic phase: In the nematic phase, the system has 
to rotate 180°, instead of 90°, to go back to itself. To 
understand the basic mechanism behind the spontaneous 
Fermi surface distortion (which costs kinetic energy), we 
count the interaction energy between all four van Hove 
points. As shown in Fig. [Tfd) and discussed above, the 
interaction between opposite van Hove points is U\ while 
between neighboring points is L^- The total interaction 
energy is 

E t ot = Ux(n A n B + n a np) + U 2 {n A + n B )(n a + n fi ). 

In the isotropic phase, ha = ub = n a = np = no, leading 
to 

^E Q = (2U 1 +4U 2 )n 2 . 

In the nematic phase, quite generally we have nA = nu = 
no — 6, n a = np = no + 6, where S characterizes the 
distortion. This leads to total interaction energy 

iCr = Eo + (2U 1 -4U 2 )S 2 . 

Therefore if U\ < and U 2 > 0, which we have shown 
is exactly the case for dipolar interaction in Eq. @ and 
Q , the nematic phase is energy favored over the isotropic 
phase with net energy gain 

AE = (21*7x1 +4|[/ 2 |)<5 2 > 0. 

Similar argument was elaborated by Halboth and Met- 
zner [23| in the context of the two-dimensional Hubbard 
model away from half filling. There, the effective inter- 
actions between van Hove points come from a renormal- 
ization procedure, while in the present case, the required 
interactions come directly from the dipolar interaction. 

To formulate a HF description of the nematic phase, 
we notice that because of the lattice translational sym- 
metry, the crystal momentum is still a good quantum 
number and the nematic state can be described by a dis- 
tribution function = Q(ji — eV) 0, [38| where eg is the 
renormalized dispersion to be specified and fl is the cor- 
responding chemical potential determined by the fermion 
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density. With this ansatz, the Hartree-Fock Hamiltonian 
for the nematic phase is 

HhT = X>~S - A)4% - NV(Q)n 2 

k 

+ ^E^-^'K^' ( 6 ) 

kk> 

with jj, = fi — 2V(0)n and 

k' 

Note that (or equivalently eg) has to be solved self- 
consistently from Eq. ((6]) and Eq. (J7|). From Eq. ((6|), 
— 2V(k— k') is identified as the interaction between quasi- 
particles with momentum k and k' . For calculations with 
fixed density, the Hartree term 2V(0)n is independent of 
k and only shifts the chemical potential by a constant, 
therefore for simplicity we denote the chemical potential 
with fj, (instead of p) in following discussions. The ne- 
matic order parameter M nem can be defined as 

M nem _ ^ (h x ,k y ~ h y ,kj' (8) 

0<k :c <ky<iT 

Note the summation is restricted in the first quadrant of 
the Brillouin zone and only for k x < k v , because parity 
is conserved in the nematic phase. One notes that the 
formalism described here applies to the smectic phase. 

A. Phase boundaries 



T 



o-o sDW instability 
» « Smectic instability 




1.43 0.44 4 5 0.46 4 7 4 8 049 0.5 
Filling (n) 



FIG. 2: The phase boundaries of staggered density wave 
(solid) and smectic phase (dashed) for i! = 0, n = 0.44 — 0.5. 
The ordered quantum phase is above the respective transition 
line. 



For given t' and n, we first compute the critical interac- 
tion strength U c for both the staggered density wave and 
the nematic or smectic phase. Whichever has a smaller 
U c is identified as the leading instability of the system. 



For example Fig.[2]shows U c for both phases as a function 
of n for t' = 0. For these parameters the smectic phase is 
the leading instability when 0.46 < n < 0.5, while stag- 
gered density wave is the leading stability for n < 0.46. 
Table I summarizes the results for several t' and fillings 
n. We found when t' is negative enough and the filling 
is not too close to the van Hove points, the system first 
undergoes a weakly first order transition to the nematic 
phase before entering the smectic phase. 





sDW 


Nematic 


Smectic 


t' = 


n < 0.46 


no 


0.46-0.5 


t' = -0.1 


n < 0.43 


no 


0.43-0.47 


t' = -0.2 


n < 0.39 


0.39-0.41 


0.41-0.45 


t' = -0.3 


n < 0.36 


0.36-0.38 


0.38-0.4 



Table I: The leading instability for if = 0, -0.1, -0.2, -0.3 
and n < 0.5. 



B. The order parameter 




FIG. 3: (a) The nematic order parameter as a function of U. 
(b) The Fermi surface in the first quadrant of the Brillouin 
zone for U = 5.8 (isotropic), 6 (nematic), and 6.2 (smectic). 
These results are computed at t' — —0.2 and n = 0.4. 

Fig. GDJa) shows the general behavior of nematic or- 
der parameter M nem as a function of U, computed for 
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if = —0.2 and n = 0.4. The interaction strength U 
can be divided into three regions. For small U (Re- 
gion I), the system is isotropic as indicated by the Fermi 
surface for U — 5.8 (solid curve) in Fig. [SJb). When 
U > U^ em ~ 5.9 (Region II), the symmetry between the 
x and y direction is broken, the systems enters the ne- 
matic phase, and the corresponding Fermi surface, elon- 
gated in the x direction, is shown (dashed curve) in 
Fig. [3jb) for U — 6.0. We emphasize that the isotropic- 
nematic phase transition is of weakly first order. Finally, 
when U > U C 2 ~ 6.15 (Region III), there is another jump 
in the order parameter corresponding to a Lifshitz tran- 
sition into the smectic phase. The open Fermi surface for 
U — 6.2 is shown (dot line) in Fig. (3Jb). This transition 
is also referred to as the meta-nematic transition which 
emphasizes the the jump between non-zero values of the 
order parameter [38|, E5| • We also note that if the filling 
is such that the Fermi surface is too close to the van Hove 
points or the second nearest neighbor hopping t' is not 
negative enough (e.g. the first two rows of Table I), the 
nematic region II disappears and the system undergoes 
a first order transition directly to the smectic phase. In 
the following we discuss in more details about these two 
transitions. 



C. The isotropic to nematic transition 

The transition to the liquid crystal phases was shown 
previously to be first order for lattice systems [f| 0] • Fol- 
lowing the argument of Ref. @, one can expand the 
ground state energy in terms of the order parameter Q 
as 

E(Q)=E(0) + ^Q 2 + jQ 4 + ... . (9) 

The coefficient B is proportional to the cubic correction 
to the linearized dispersion around the Fermi momentum 
which is generally negative for realistic band structures 
0;01- For example, for the tight-binding band we con- 
sider here e(k) = —2t(cosk x + cosk y ) — At' cosk x cosfc y , 
the cubic term in the expansion of e(fc/ + (q, 0)) — e(kf) in 
q with kf = (a, 0) is proportional to — (t+2i') sin a which 
is normally negative (2\t'\ < t). Negative B makes the 
isotropic-nematic transition first order. In this case the 
nematic phase is expected to be stabilized by the higher 
power term of Q in the energy, for example Q 6 . 

If kf is too close to the van Hove points, the system 
undergoes phase transition directly from the isotropic to 
the smectic phase. On the other hand, if fc/ is far away 
enough from van Hove points and t' is negative enough 
to reduce the quartic contribution (make \B\ smaller), 
there is a finite window for stable nematic phase. For 
the model considered here we found t' has to be smaller 
than — Q.2t for the nematic phase to occur. 



D. The linear response analysis 

To analyze the Fermi surface instability in more detail, 
we consider the response Sn^ caused by a Fermi surface 
perturbation d/jj: [46ll47| . The perturbation modifies 
the effective dispersion from eg to e'-. To the linear order 
of d/i^, the change e'- — eg — jdp,^. Accordingly, 

5n % = -<%-m) [eg 

= +<% - M) x (1 - i)d H . (10) 

We define the momentum-dependent compressibility as 
n(k) — Sn^/dfj,^ — +S(et — /z) X (1 — 7). A stable Fermi 
surface has positive compressibility (1 — 7 > 0). We have 
assumed that 7 is fc-independent despite the presence of 
lattice. The validity of this assumption will be estab- 
lished shortly. Using Eq. [7J one finds 

H - h = -| E V $ - - M)(l - 7)dMS>. (11) 

%' 

This equation, combined with the definition of 7, leads 
to the eigenvalue equation 

Y. c kk> d H> = Xd H> (I 2 ) 
ft' 

with A = j^- andc££, = -jfV{k-k')6(e^—fj,). I-7 > 
translates to A > — 1, so the condition for stable Fermi 
surface becomes Det(c££, + 1) > 0. The delta function in 
the definition of matrix err, has to be treated with care in 

kk' 

numerical calculations, this is discussed in the Appendix. 

We first discuss the implications and limitations of 
Eq. (fT2")l . First, in the eigenvalue equation, the eigen- 
vector {d/ij:} corresponding to the eigenvalue approach- 
ing A = — 1 provides information about the shape of 
Fermi surface in the nematic phase. Second, c^p con- 
tains a S function, indicating that only k points at the 
Fermi surface defined by the renormalized eg are rele- 
vant. As explicitly shown in the appendix, the 5 func- 
tion further implies that the main contribution is from 
k points whose renormalized Fermi velocities |Veg| are 
smallest, i.e. where the dispersion is flat and there are 
plenty of states with energies close to fi. Those points 
are related by lattice symmetry operations (rotations and 
reflections). When applying Eq. (TT21 to determine the 
instability, the weak k dependence of 7 can be safely ig- 
nored. Finally, Eq. (fT2|) fails due to divergences when 
the Fermi surface crosses the van Hove points. It also 
becomes inapplicable if the phase transition is of first 
order. 

Because the transition is only of weakly first order, 
we apply Eq. (fT2"j) to analyze the transition between the 
isotropic (Region I) and the nematic (Region II) phase. 
First, the nematic instability can be detected by the 
emergence of negative eigenvalue of matrix (crp + I), 
where / is the identity matrix. We find that for the 
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6/2jc 



FIG. 4: The eigenvector of the softest mode of Eq. ()12p com- 
puted for U = 5.8, t' = -0.2, and n = 0.4. 



IV. ZERO SOUND 

Following the standard Landau Fermi liquid approach 
46] . we derive the quantum kinetic equation to determine 
the collective excitation spectra in the isotropic phase 
[48l . The main question is whether zero sound is a 
well denned collective mode driven by the dipolar inter- 
action. The starting point is to generalize Eq. ([7]) by as- 
suming slow spatial (f) and time (t) dependence of both 
the distribution function n^(r) and the effective disper- 
sion f-Af), 



N 



(13) 



nematic transition, which we find is of weakly first or- 
der, the critical value [/™ em obtained by the Hartree- 
Fock approximation is roughly 5% smaller than that by 
analysis using Eq. (fl"2")) . Actually even for the isotropic- 
smectic transition, U^ mec from Eq. (fl"2j) is found to be 
just roughly 10% larger than the mean field result. Since 
the Hartree-Fock calculation converges very slowly near 
the transition, it is of advantage to determine U c from 
the linear response analysis presented here. Second, the 
eigenvector of the softest mode, i.e., the one correspond- 
ing to the smallest eigenvalue of cg£, + I in Eq. (TT2"1) . 
tells how the Fermi surface deforms in the nematic phase. 
Fig. 2] shows the softest eigenmode dfig for U = 5.8, 
t' = —0.2, and n — 0.4, where the angle 8 = tan -1 ^- in 
the polar coordinate. Here d/ig, the perturbative defor- 
mation of the Fermi surface, is consistent with the Fermi 
surface in the nematic phase obtained in HF calculation, 
the dashed curve in Fig.^b). 



E. The meta-nematic transition 

The order parameter jump across the nematic-to- 
smectic or isotropic-to-smectic transition is also closely 
related to the van Hove singularities. The Fermi sur- 
face is defined by = fi. For a given direction, the 
change in Fermi momentum Afejr due to a change in the 

Because 



|V S E| ' 



chemical potential Afi is proportional to 

the area enclosed by the Fermi surface is conserved for a 
given density (known as Luttinger's theorem), when the 
anisotropy of the nematic phase is increased by increasing 
U, a shrink of Fermi surface in one direction (say y) must 
be compensated by the expansion in the other (say x) di- 
rection. When the expansion is to include some van Hove 
points, such as (±7r, 0) in Fig. [2Kb), the area increase in 
that direction is infinitely large compared to the shrink 
in the other direction, i.e., Akp(x) / Akp(y) — > oo. For 
this reason the transition from a closed to an open Fermi 
surface cannot be smooth, which is reflected on the jump 
of nematic order parameter. 



and assuming quasi-particles are in local equilibrium. 
In the collisionless regime, the equation of motion for 
5n^{r,t) is given by 



Ql l " k ' Qjt k ' ^ a 7* k 



dk dk [ 



dr 



= 0. 



Defining = Vr;?£ and using Eq. (1131) . the above equa- 
tion becomes 

d d 

— [Sn^r,t)} + —[Sn i {r,t)}-v j : 

+ ^-riV^£n*- = o. (14 , 



dr 



Seeking a wave solution of the form 5n^(r,t) — <J(ec 
pi)u^e l ^' r ~ Ui ' t \ we obtain the equation for zero sour 
with wave vector q and frequency w<? as 



J2 D ^kk' u k> = w ^fe 



(15) 



E 



up. 



This is again an eigenvalue equation. Note that both 
D{q)^, and w$ are linear in q. 

For our specific model, we find that in the isotropic 
phase, all eigenvalues of D{q) in Eq. (fl5|) are real and 
bounded from above, \u)^\ < \q-Vp\ max . This implies that 
the zero sound modes overlap with particle-hole contin- 
uum and are strongly Landau damped [46j . Therefore 
zero sound is not an independent, well defined excitation 
of the system. The nematic instability occurs when the 
eigenvalue frequency uj^ becomes imaginary (numerically 
we find that two of eigenvalues become purely imaginary 
across the nematic transition). The nematic boundary 
determined in this way is also consistent with those ob- 
tained from the Hatree-Fock and linear response analysis. 
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V. EXPERIMENTAL IMPLICATIONS 

Now we estimate the experimental parameters required 
to observe the nematic phase using polar molecules. The 
optical lattice is characterized by the laser wavelength A 
(the lattice constant ao = A/2) and the lattice poten- 
tial depth Vq is measured in unit of the recoiled energy 
En = h 2 /(2mX 2 ) [50]. The hopping amplitude is es- 
timated as t = E R {2/^)Tf/ A e- 2 ^ with 77 = V Q /E R 
5 If . Typical values of the wavelength is 500-1000 nm 
and r\ 5-30 leading to t of the order a few or tens 
of Hertz (multiplied by the Planck constant h) . For the 
dipolar interaction energy U = 2d 2 /a^ to reach liquid 
crystal phases (for example, U > 6t for the phase dia- 
gram shown in Fig. [3]), the dipole moment d of a few 
tenths of Debye is required. For example by taking t to 
be 10 Hz and ao 500 nm, d has to be roughly 0.18 Debye 
such that d 2 /a,Q — 60 Hz. This value is comparable to 
those observed in the current experiments [30(. Finally 
we mention the anisotropy in the momentum distribu- 
tion within liquid crystal phases can be directly probed 
in the time of flight (TOF) measurements - after turn- 
ing off the trap, the expansions of the dipolar gases in 
x and y directions become significantly different as com- 
pared to the isotropic or sDW phase. According to the 
local density approximation, the inhomogeneity induced 
by an external harmonic potential makes the liquid crys- 
tal phase coexist with other phases in the optical lattice. 
Since normal and sDW phases both result in isotropic 
expansions in TOF, the presence of these phases weak- 
ens, but cannot eliminate, the anisotropic signal from the 
liquid crystal phase. 



optical lattice with the external field perpendicular to 
the plane. We find that strong enough dipolar interac- 
tion can drive the system into a nematic and further into 
a smectic phase. In particular we find that, apart from 
the staggered density wave, for a finite range of filling 
and hopping the nematic /smectic phase is the leading 
instability. In a simplified picture, the nematic/smectic 
instability can be understood as driven by the dipolar 
scattering between van Hove points, although one has to 
bear in mind that the transition exists even in the absence 
of van Hove singularities. The transition from isotropic 
to liquid crystal phase is generally of first order. The 
transition from the nematic to the smectic phase is asso- 
ciated with a jump in the nematic order parameter which 
is required by Luttinger's theorem and closely related to 
Fermi surface passing through the van Hove singularities. 
The zero sound mode in the isotropic phase is found to 
be strongly Landau damped and is not a well defined 
excitation of the system. Finally, our estimate indicates 
that the parameter regimes for the liquid crystal phases 
are within the reach of experiments in near future. 
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Appendix A: The 5 function 

Here we describe how to numerically implement 
Eq. (1T21) . Explicitly, we compute (replacing efytg in 
Eq. (USD by u g ) 

2 _ _ 



In principle, the k' summation is over the whole Brillouin 
zone which makes c^, an iV 2 x N 2 matrix. However, 
since the Fermi surface is known, only ug on the Fermi 
surface are involved in Eq. (|12)l. To treat the 5 function 
properly, we first replace the summation by an integral, 
i.e., 



^ C kk' U k' 



(27T) 



dKdk'vik-ky^-^up, 



and then change variable to e = e(k x ,k y ) and 9 
tan -1 I 2 -, leading to 



d kx dky d d k^ 
~di~d9 ~ ~~d£~d9 



dUO = l/\vt x Vt9\edd, 



where V^6* = (~k y ,k x )/k 2 and = V^e. Define the 
Jacobian J(k) = x Vg0|. In the (e, 9) coordinates, 

the 8 function integration restricts k' on the Fermi mo- 
mentum k F (6'), yielding 



^ C kk' U k' 



2*) 



2 71 



d9'J{k F (9'))V(k~ k F (9'))u 0l . 



Then Eq. (fl"2|) becomes a discretized equation of 



-2 



2tt 



d9'J{k F (9'))V(k F {9) - k F (9'))u e , 
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One notices that due to the Jacobian, the k points of above integral is not well defined anymore (logarithmi- 
smaller Fermi velocities contribute more to the integral. cally divergent). 
However, when = 0, the Jacobian diverges and the 



